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where S T is a sum £1 + . . . + £ T of random size r and M T is a maximum of partial sums 
M T = max„< T S n . Here £„, n = 1, 2, . . . , are independent identically distributed random 
variables whose common distribution is assumed to be subexponential. We consider mostly 
the case where r is independent of the summands; also, in a particular situation, we deal with 
a stopping time. 

Also we consider the case where E£ > and where the tail of r is comparable with or 
heavier than that of £, and obtain the asymptotics 

Ph " 

-t— > . 

d , This case is of a primary interest in the branching processes. 

In addition, we obtain new uniform (in all x and n) upper bounds for the ratio P{S n > 
a;}/P{£i > x} which substantially improve Kesten's bound in the subclass Sf* of subexpo- 
nential distributions. 
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P{S T > x} - ErP{a > x} + P{r > x/~E£} as . 



1. Introduction 



Let £, £i, fa, • • • be independent identically distributed random variables with a finite mean. 
We assume that their common distribution F is right-unbounded, that is, F(x) = P{£ > x} > 
for all x. Moreover, we assume that F has a heavy (right) tail. Recall that a random variable 77 has 
a heavy-tailed distribution if Ee e,? = 00 for all e > 0, and light-tailed otherwise. 

Let So = and S n = £1 + . . . + £ n , n = 1, 2, . . . , and let M n = maxo<j<„ Si be the partial 
maxima. Denote by F* n the distribution of S n . 

Let r be a counting random variable with a finite mean. In this paper, we study the asymptotics 
for the tail probabilities P{S T > x} and P{M T > x} as x — ► 00. 

It is known that, for any distribution F on R + and for any counting random variable r which 
is independent of the sequence {£n}> 

lim mf — ^= > Et, 

x^co F(x) 
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see, e.g. Il35l [lOl . It was proved in the series of papers |[T3l |9l [TDJ that if F is a heavy-tailed 
distribution on R + with finite mean and if P{cr > x} = o(F(x)) as x — ► oo, for some c > E£, 
then 

Hminf ^S-^ =Et. (1) 

x^oo F(x) 

This gives us the idea what asymptotic behaviour of P{S T > x} should be expected, at least if 
the tail of r is lighter than that of £. In particular, by considering the case r = 2, we conclude 
that if F is a heavy-tailed distribution on R + and if P{S < 2 > x} ~ cF(x) as x — > oo, for some 
c, then c = 2 with necessity (see Ifl3l0 . By the latter observation, we restrict our attention to 
subexponential distributions only. 

A distribution F on R + with unbounded support is called subexponential, F G S*, if F * F(x) 
2F(x) as x — > oo. A distribution F on R is called subexponential if its conditional distribution on 
R + is subexponential. It is well known that any subexponential distribution is heavy-tailed and, 
even more, is long-tailed. A distribution F with right-unbounded support is called long-tailed if 
F(x + y) ~ F(x) as x — > oo, for any fixed y. 

The key result in the theory of subexponential distributions is: if F is subexponential and if r 
does not depend on the summands and is light-tailed, then 

P{SV > x} ~ ErF(x) as x ^ oo. (2) 

A converse result also holds: if, for a distribution F on R + and for an independent counting 
random variable r > 2, P{S T > x} ~ EtF(x) as x — > oo, then F is subexponential (see, e.g. 

CD). 

The intuition behind relation ® is the principle of one big jump: in the case of heavy tails, for 
x large, the most probable way leading to the event {S n > x} is that one of n summands £i, . . . , 
£ n is large while all others are relatively small. Asymptotically this gives the probability nF{x), 
and conditioning on r yields to the multiplier Er. The keystone of the proof is Kesten's bound: 
for any subexponential distribution F and for any e > 0, there exists K = K(F, e) such that the 
inequality 

F*"( x ) < if (1 + £ ) n F(x) 

holds for all x and n; see, e.g. EJ Section IV. 4]. Clearly this estimate does not help to prove 
(O if the distribution of r is heavy-tailed. So the question of the basic importance is: If we fix 
a subexponential distribution F, then what are the weakest natural conditions on r which still 
guarantee relation © to hold? Intuitively, the light-tailedness assumption seems to be very strong. 
The study of this problem is one of the main topics of the present paper. 

In order to state our first result, we need to introduce the notion of J/"* -distribution. A distri- 
bution F on R with a finite mean belongs to the class y* if 



/ F(x — y)F(y)dy ~ 2aF(x) as x — > oo, 
Jo 



where a = 2 f °° F(y)dy. It is known (see Kliippelberg |[T8l ) that any distribution from the class 
is subexponential. Though these two classes, o5^* and 5t ', are considered as rather similar, 
there exist subexponential distributions which are not in «5^*, see, e.g. HI and the discussion in 
Section [2] below. Classical examples of distributions from the class J?"* are Pareto, log-normal, 
and Weibull with parameter [3 G (0, 1). 
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Theorem 1. Assume that a counting random variable r does not depend on Let F G S fi *. 
(i) TfEf < then 



P{S T > x} ~ P 



{M T > x} ~ ErF(x) <35 x — > oo. 



(3) 



(ii) Tjf E£ > arcc? if there exists c > E£ smc/j that 



P{cr > x} = o(F(x)) as x — > oo 



(4) 



?/zen asymptotics ([3]) again hold. 

The latter theorem shows that if we restrict our attention from the class of all heavy-tailed 
distributions to the class J?*"*, we obtain equivalence © which is stronger than assertion (Q} for 
the 'liminf. Definitely we should assume the subexponentiality of F in order to get ©. At the 
end of Section S] we construct an example demonstrating that the stronger condition F G y* is 
essential for the statement to hold in the whole generality and cannot be replaced by condition 

Fey. 

The proof of Theorem Q] is carried out in Section [4] Statement (i) can be found in lfT31 ; in 
Section|4]we give an alternative proof of (i). Note that these two cases, negative and positive mean 
of £, are substantially different in their nature. 

Condition © seems to be essential, since, for any c < E£, 



as x — ► oo, due to the convergence P{S T > x\ct > x} — > 1, by the Law of Large Numbers. In 
particular, for r with a regularly varying tail distribution, condition ((U) is necessary for asymptotic 
relation © to hold. Further discussion on condition (@]) can be found in Section @] 

Stam in ll37l Theorem 5.1] and A. Borovkov and K. Borovkov in J3j Section 7.1] obtained 
asymptotics © under condition (@]) for regularly varying F. Some results by Stam 11371 have been 
proved again by Fay et al. in |[T2l . The case where F is a dominated varying distribution was 
studied by Ng et al. |[30l and by Daley et al. J6]]. A subclass of so-called semi-exponential F 
was considered in J3l Section 7.2]. In |[T5l Corollary 2], asymptotics © were obtained in the case 
E£ > under the extra assumption P{r > h(x)} = o(F(x)) for some function h{x) — ► oo such 
thatF(x±/i(x)) ~F(x). 

In Section [U we derive new simple uniform upper bounds for the ratio F* n {x)/F(x) which 
generalise Kesten's bound for 5?* -distributions. We prove the following 

Theorem 2. Assume that F G 5?*. IfE£ < 0, then there exists a constant K such that 



P{S T > x} 



= P{SV > X, CT < x} + P{SV > X,CT > x} 

> (Er + o(l))F(x) + (l + o(l))P{cr > x} 



F* n (x) 
F(x) 



< Kn for all n and x. 



TfE^ G [0, oo), then, for any c > E£, there exists K such that 



F* n (x) 
F{x) 



< 



F(cn) 



K 



for all n and x. 
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The latter estimates are also of their own interest. They substantially improve similar bounds 
in Shneer ll36l Theorems 1 and 2] (see also Daley et al. Theorem 3]). In Theorem HJ Section 
EJ we show that the condition F G y* is essential for the statement of Theorem [2] to hold; more 



precisely, we construct a distribution F G y \ y* with negative mean such that sup n >x 
oo. 



A closely related topic is the asymptotics of the type P{S n > x} ~ nF(x) as n, x — > oo 
which have been extensively studied starting from 60s. The first works are remarkable papers of 
S. Nagaev |25ll26l , Linnik [f2TTl (in this paper, in a special case, the asymptotics are stated, but the 
key relation (10.10) on p. 303 is not supported by a proof), and later on of A. Nagaev IT231 l24l 
where in particular the regularly varying distributions were considered. Namely, if F is regularly 
varying with the parameter a > 2 and E£i = 0, E£| = 1, then under mild technical conditions 
(see IT231 . ll28l Theorem 1.9], or |[32l Theorem 6]) the following asymptotics hold 

P{S n > x} ~ $(x/\/n) + nF(x) as x — > oo uniformly in n < x 2 ; 



here is the tail function of the standard normal law. Further, it follows that, if x< -J (a—2—e)n In n, 
then the asymptotics follow the Cental Limit Theorem, while if x > yipt — 2 + e)nlnn, then the 
probability of a single big jump dominates. For Weibull-type distributions the situation is more 
complicated, see, e.g., A. Nagaev |[24l . S. Nagaev IT271 . Rosovskii |[33l l34l . Detailed overviews 
of results in the theory of large deviations for random walks with subexponential increments are 
given in S. Nagaev IT281 and in Mikosch and A. Nagaev ll22l . There is still an ongoing research in 
this area, see recent works by A. Borovkov and K. Borovkov [3), A. Borovkov and Mogulskii JU, 
Denisov et al. Q and references therein. In Section [3] of this paper, for an arbitrary distribution 
F £ y*, we find a range for n = n(x) where the asymptotics P{S n > x} ~ nF(x) hold. The 
corresponding proof is surprisingly short. 

In Section [51 we study the case where the tail distributions of r and £ are asymptotically 
comparable and, for a subclass of subexponential distributions, we obtain the asymptotics for 
P{SV > x} which differ from (O, see Theorem [U This generalises results by A. Borovkov and 
K. Borovkov Q and by Stam 071 . see Section[5jfor further comments. As a corollary, in Section 
[6l we obtain new tail asymptotics for Galton-Watson branching processes. 

In Section |7J we study the case where r may depend on {£ n }» in particular, where r is a 
stopping time. First, we prove Theorem [9] where we obtain equivalence 0J for bounded r. In the 
proof, we adapt the approach developed in fTBI and generalise Greenwood's result onto the whole 
class of subexponential distributions. Then we consider an unbounded r and prove Theorem 
[TOl which states that equivalence 0J holds under a stronger assumption than Q (see condition 
(l37l > below). Theorem [10] geleralises earlier results by Greenwood and Monroe ifTTl and by A. 
Borovkov and Utev jJJ, see Corollary [3] and comments after it. Concerning the asymptotics for 
the maximum, it was shown in |[T5l (see also iTRll ) that the equivalence P{M r > x} ~ ErF(x) 
holds without any further assumptions on the tail distribution of r if E£ < and under condition 
(I37T ) otherwise. 



2. Uniform upper bounds for tails; proof of Theorem [2] 

In this Section, for the ratios F* n (x)/ F(x), we derive more precise upper bounds than Kesten's 
bound, which are again uniform in x. We consider two cases E£ < and E£ > separately. We 
need the following result: 
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Theorem 3 (J2Q1 and [81 Corollary 4]). Assume that F £ ^* and E£ < 0. Then, as x — > oo and 
uniformly in n > 1, 

^ /.a;+n|E£| _ 



P{M n > x} ~ — - y F(y)dy. 



Proof of Theorem^ First we consider the case (i) of negative mean. Taking into account the 
inequality S n < M n , Theorem |3j and the inequality 

rx+n\Ei\ _ 

/ F(y)dy < nF(x), (5) 

J X 



we obtain statement (i) of the theorem. 

Now consider the case (ii) where E£ > 0. Take c > E£. Put & = & — c and S^i = . . +£n- 
Then E£ = E£ — c < and again we can apply Theorem[3] Thus, there exists a constant K\ such 
that, for all x and n, 

__ ,n|Efj _ 

< K x I F(x + y)dy 

Jo 

where F in the distribution of £. Therefore, 

i>nc _ 

P{5„ > x} = P{S n > x-nc} < K i / F(x - nc + 

JO 
rnc __ 

= K x \ F{x - y)dy. 
Jo 

Since F £ the distribution F is long-tailed and, hence, ~ F(x) as a; — > oo. Then 

(•nc 

P{5 n > x} < K 2 F(x - y)dy, (6) 
Jo 

for some constant iv~2 and for all x > 0. If x > nc, then 

_ rnc_ pf \ 

F{x-y)dy < / F(x-y)=f^-dy 
Jo F(nc) 

F(y) F(x) 

< / F(x-y)=p-dy<K 3 =^- 
Jo F(nc) F[nc) 

where 

1 f x — — 

K 3 = sup =— / F(x - y)F(y)dy 
x >o F[x) Jo 

is finite, owing to F £ y* . If x < nc, then 



f 

Jo 



F* n (x) < 1 < = 
V V - - F{nc) 

These two bounds together with © complete the proof of the second assertion of Theorem [2] 

From Theorem [2] and from the dominated convergence theorem, we deduce the following 
corollary. 
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Corollary 1. Tail equivalence (0) holds ifFG y* and E£ > 0, provided that 

^p{ T = n } 

> — — — - — < oo for some c > E£. 
z — f F(cn) 

n=l v ' 

The latter condition is stronger than condition ((U), because 

P{r > A;} P{r = n} 

^(cfe) " ^ F(cn) 

Now let us discuss the importance of the condition F G y* in Theorem |2l The following 
observation shows the essence of the difference between two classes of distributions, y and y* , 
is the following one. Let a long-tailed distribution F be absolutely continious with density /. For 
any function h(x) > 0, 

x— h(x) rx—h(x) 

F(x-y)F(dy) = / F(x - y)f(y)dy. 

h{x) Jh{x) 

Then F is subexponential if and only if 

/•x— h(x) 

/ F(x — y)f{y)dy = o(F(x)) as x — > oo 

Jh(x) 

holds for any function h(x) — > oo; equivalently, if it holds for some function h{x) — > oo such that 
F(x - h(x)) ~ F(x). On the other hand, F e y* if and only if 



rx—h(x) 

/ F(x — y)F(y)dy = o(F(x)) as x — > oo. 

In typical cases f(x) = o(F(x)) and, hence, 

rx—h(x) I i-x-h(x) \ 

/ F(x - y)f(y)dy = o / F(x - as x ^ oo. 



It means that the subexponentiality of F is more likely than F £ «5^*. The latter observation 
gives the idea how to show that the condition F S y* in Theorem [2] cannot be extended to the 
subexponentiality of F. 

Theorem 4. There exists a subexponential distribution F onTL with a negative mean such that 



F* n k(x k ) > c— ^F(xfc), 
m 

for some c > and for some sequences n^, x^ — > oo. 

The latter theorem yields that, for some distribution F G y\ y* with negative mean, the first 
estimate of Theorem |2] fails, that is, sup n x ^y^p = 
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Proof of Theorem |U We start with a construction of a specific subexponential distribution G on 
the positive half-line. Put Rq = 0, i?i = 1 and R k+ \ = e k / 1 R k for k > 1. Since e^/x is 
increasing for x > 1, the sequence i?^ is increasing and 

R k = o(R k+ i) as A; -> oo. (7) 

Put tfc = Define the hazard function i?(x) = — In G(x) as 

R(x) = R k + r k {x-t k ) for x e (t k ,t k+1 ], 

where 

-Rfc+i — Rk 1 1 
r k = = ~ (8) 

tk+l — tk Rk+l + Rk Rk+1 

by ([7]). In other words, the hazard rate r(x) = R'(x) is defined as r{x) = r k for x E (t k , t k+ i], 
where r k is given by ([8]). By the construction, we have G{t k ) = e~^, so that at points t k the 
tail of G behaves like the Weibull tail with parameter 1/2. Between these points the tail decays 
exponentially with indexes r k . 

We prove now that G has finite mean and is subexponential. Since by ([8]) 

r k 1 ( e ~ Rk ~ e' Rk+1 ) 
r^e- 11 * ~ R k+1 er R * = 1/R k , 
the mean of G, 

/ G(y)dy = V / G(y)dy, 
Jo k=0 Jt k 

is finite. 

It follows from the definition that r(x) decreases to 0. Then we can apply Pitman's criterion 
lOTI which says that G is subexponential if the function e yr ^ y '~ R ^r(y) is integrable over [0, oo). 
In order to estimate the integral of this function, put 

I k = / e*<*)-m r (y) d y. 

Then 

I k = r k e vr k -(Rk+r k (y-t k )) dy < rfce -Sk+r*t* ifc+1 . 

Jt k 

Since 




r k t k 



4-1 



fe+i 



(9) 



by © and 



r k t k 



r kRl 



R? k /R 



fc+i 



0. 
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we get Ik < 2Rk+\e Rk ^ for k sufficiently large. Therefore, 

poo 00 

/ e y r (y)-R(y) r (y)d y = V l k < oo, 

Jo k=Q 

and G is indeed subexponential. 

In the sequel we need to know the asymptotic behaviour of the following internal part of the 
convolution integral at point t k : 

/•3tfe/4 r 3t k /4 
Jk= / G{t k -y)G{dy) = / e~ R ^e- R ^r{y)dy. 

Jt k /i Jt k /4 

Owing to (f7]>, tk-i = o(t k ). Thus, (ifc/4, 3£jt/4] C (tk-i,t k — ifc-i] for all sufficiently large 
For those values of fc, we have 

_ /*3tfc/4 

4 = G{t k ) / e -(-^-lJ/) e -(«fc-l+^-lfe-^-l)) rfc _ 1 dy 

> G(t k )(t k /2)e- R ^r k ^. 
Applying (O and the equality e^- 1 = R k R k -\, we obtain, for all sufficiently large k, 

Jk > G(t k )e- Rk -^R k /3 = S(tfc)/3/2 fc _i. (10) 

Let 771, 772, • • • be independent random variables with common distribution G and put T n = 
r\\ + . . . + rj n . For any n, we have 

P{T n > x} > ^2 P{T n > x,r]i> n, r]j > n,r]i <n for all l^i,j} 

l<i<j<n 

n(n — 1) 

= 5 P i Tn > x iVi > n ,m > n ,V3 < n, . . . ,r] n < n\. 

Since jy's are positive, the latter probability is not smaller than 

P{f?i + V2 > x, ?7i > n, % > n}P{r] 3 < n, . . . ,rj n < n}. 
The mean of rj is finite, thus G(n) = o(l/n) as n — > 00 and 

P{% < n, . . . , r) n < n} = (1 - G(n)) n ~ 2 -> 1. 
Putting altogether, we get, for all sufficiently large n, the following estimate from below 

P{T n > x} > yP{i)i + r/2 > x, 771 > n, r]2> n}. (1 1) 

Now take n = n k = [^/t k ] = [R k ]. Then, for all sufficiently large A; (at least for those k where 

nk < 4/4), 

P{??1 + ??2 > 4, 771 > n k , 7] 2 > n k } > J k . 
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Therefore, by (fTTT) and (fT0T >. for all sufficiently large k, 

P{T nk > t k } > n 2 k G(t k )/9R k ^ ~ nlG(t fc )/91nn fc , 

due to ~ lni?^ ~ lnn^. 

Denote 6 = Er/i. Put Ci = ~ 26, then £'s have negative mean and 5 n = T n — 2nb. Denote 
by F the distribution of £1; it is subexponential because G is. 



Take x = x k = tk — 2n k b, so that x,t ~ n?. By the latter inequality we have 



P{S rik > x k } = P{T nk > t k } > n 2 G{t k )/ Win n k . 

Note also that 

F(x k ) = G(t k - 2n k b) = G(t k )e r ^ 2n * b < G(t k )e 2b 

because r k _\n k < r k ^\R k < 1 by ([8]). Therefore, the inequality 

P{S nk > x k } > n 2 k F(x k )e- 2b /10mn fe 

holds which yields the conclusion of the theorem. 

The subexponential distribution G constructed in the latter proof cannot belong to the class 
5^* because otherwise the theorem conclusion fails, as follows from Theorem [2] The fact that 
G g" 5?* can also be proved directly. Kluppelberg's criterion |[T8l states that G £ 5?* if and only 
if 

PX POO 

/ e yr ^- R ^dy / G{y)dy as x — > oo. 

Jo Jo 



In our construction, 



yr{t k -0)-R{y), / yr k _^-R(y) 



e yr^ k -^-n K y }dy > . ^n.-x-«\S) dy 
Afc_i 

> (t fc - t k ^)e- R ^ 

~ Rle'^- 1 = e^" 1 -» oo 

as fc — > oo. Hence, G 

3. On the asymptotics P{S n > x} ~ nF(x) 

As before, we assume E£ to be finite. Then, by the Strong Law of Large Numbers, 

P{S n > -An} — ► 1 as ^4 — ► oo uniformly in re > 1, (12) 

and by the Chebyshev's inequality 

P{£i > An} < E|Ci|/An for all A > and n > 1. (13) 

Theorem 5. Le? G J^* owe? Zef an increasing function h{x) > be such that F(x ± ~ 
-F(cc). r/ze?i P{S n > x} ~ nF{x) as x — » oo uniformly in n < h{x). 
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Proof of the lower bound is similar to that in J7J Section 4]. Fix A > 0. We use the following 
inequalities: 

n 

P{S n > x} > F i S n > x,ii> x + An, < An for all j / i} 
i=i 

> nP{S n - £i > -An, £i > x + An, £ 2 < An, ...,£„< An} 
= n~F(x + Ari)P{S n -i > -An, £i < An, £ n _i < An}. 

We have F(x + An) ~ F(x) as x — > oo uniformly in n < Taking also into account that 

P{S n _i > -An, a < An, ... , f n _i < An} > P{S n ^ > -An} - (n - 1)P{6 > An}, 

we get, for any fixed A > 0, 

liminf inf p {^» > g } > i n f(p{5 n _ 1 > -An} - (n - 1)P{6 > An}). 

x^oo n <h(x) nF(x) n 

Since the infimum on the right goes to 1 as A — > oo owing to (fT2l) and (fT3T >. we arrive at the 
following lower bound 

liminf inf — {■^n > x} ^ ^ 

x-^oo n <h(x) nF(x) 

To prove the upper bound, we apply Theorem [3] to random variables d = d — E£i — 1 with 
negative mean E£j = —1 and to S n = S n — n(E£i + 1). Thus, 

P{S n >x} = P{S n > x - n(E£i + 1)} 

rx — nE^i _ 

< (l + o(l)) / F(x + u)du 

< (1 + o(l))nF(x - n(E^i + 1)) 

as x —>■ oo where i 7 is the distribution of £. If n < then F(x — n(E£i + 1)) ~ F(x) as 
x — > oo and the proof is complete. 

The range n < is usually more narrow than one could expect. Say, for the regularly 
varying distributions (more generally, for the intermediate regularly varying, see the definition in 
Section[5]) we can take h(x) = o{x). Then we get the range n = o{x) while the standard (if the 
mean is zero and the second moment is finite) range is x 2 > cn In n; in the class of distributions 
with finite mean, the relation P{S* n > x} ~ nF(x) holds in the range x > (E£ + e)n, e > 0, see 
S. Nagaev ||29l . The advantage of the result in Theorem [5] is its simplicity and universality since 
it is valid for all distributions from y* without any further moment or regularity assumptions, 
compare with a series of results in J3j |4j [Vj where the hazard rate is assumed to be sufficiently 
smooth. 

As follows from Q, if the mean is zero and the second moment is finite, then the right range 
should be n < h 2 (x), roughly speaking. Our technique allows to prove the lower bound for this 
range. 

Theorem 6. Let E£ = and E£ 2 < oo. Let F be a long-tailed distribution and let an increasing 
function h(x) > be such that F(x db h(x)) ~ F(x). Then P{S n > x} > (1 + o(l))nF(x) as 
x — > oo uniformly in n x). 
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Proof. Fix A > 0. By the Chebyshev's inequality, 

P{£i > A^} < Bf/A 2 n and P{S n > -A^i} > 1 - Ef/A 2 . (14) 
In this proof we use a slightly different inequality than in the previous theorem: 

n 

P{S n > x} > ^ P{S n > x, & > x + Ay/n, £j < Ay/n for all j / i} 

i=i 

> nP{S n - 6 > -Ay/n, ix>x + Ay/n, £ 2 < Ay/n, . . . , £„ < A^n} 
= nF(x + Ay/n)~P{S n -i > -Ay/n, £i < A^n, . . . , < ^/n}. 

Since n < h 2 {x), F(x + Ay/n) ~ as a; — > oo. Applying (fPfl ). we get 

P{5 n _i > -AVn, 6 < A^/n, • • • , Cn-i < AM 

> P{5 n _i > -.4^} - (n - 1)P{6 > A^} 

> 1 - 2E£ 2 /A 2 1 as A -> oo. 

Now the lower bound for P{5' n > x} follows. 

4. Proof of Theorem [1] 

Since r is independent of £'s, we can use the following decomposition: 

oo 

P{SV > x} = p { r = n}F™(x). 

n=0 

By the subexponentiality, here the nth term is equivalent to nP{r = n}F(x) as x — > oo. In 
particular, by Fatou's lemma, 

lim inf F{ ^ T > ^ > V nP{r = n} = Er, (15) 

v y n=0 

without any condition on the sign of E£. In the case of negative mean, the nth term is bounded 
from above by nF(x), see ©. Then the dominated convergence for series yields statement (i) of 
the theorem. 

Now turn to the proof of statement (ii) where E£ > 0. Since S T < M T , it follows from (fT5T > 
that it is sufficient to prove that 

P{M T > x} ~ EtF(x) as x -> oo. (16) 

To prove the latter relation, we start with the following representation: for any N, 

P{M T > x} = P{M T > x,t <N} + P{M T > x, t G (N, x/c]} + P{M T > x,ct> x] 
= P 1 + P 2 + P 3 . (17) 

Since any y* -distribution is subexponential and S n < M n < £f + . . . + , 

P{M n > x} ~ 
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as x — ► oo, for any n. Thus, for any fixed N, 

N 



P{M r > x, t < N} = = »} p {Mi > x] ~ E{r; r < JV}F(x) 

71=1 

as x — > oo which implies the existence of an increasing function N(x) — > oo such that 

Pi = P{M r > x, r < iV(x)} ~ EtF(jc). (18) 

In what follows, we use representation (fTTT ) with iV(x) in place of iV. We further estimate the 
second term on the right side in ( fTTT ). Let e = (c — E£) /2 > and let b = (E£ + c)/2. Consider 
£n = — b, S n = £i + . . . + and M n = max(Si, . . . , S n ). Then E£ = — e < and we can 
apply Theorem [3] Taking into account that M n < M n + bn, we obtain that there exists K such 
that, for all x and n, 



P{M n > x} < P{M n > x-bn} 

rm __ 

< K F{x -nb + y)dy 

Jo 

< K F(x - nb + y)dy. 

Jo 



Hence, 

[x/c] 



P 2 = P{M T > x,t G (iV(x),a;/c]} < if V P{t = n} / F(x - nb + y)dy. 



n=N(x) 

Since b - e = E£, 
Then 



/ F(x — nb + y)dy = / F(x — y)dy. 
Jo JnES 



Mx/c] _ 

P 2 < K F(x- y)dy Yl P i T = n > 

•^(aOEC n=max(AT(cc) ) [y/6]+l) 

< K F(x- y)P{r > y/b}dy 

JN(x)E£ 
rbx/c 

< K F{x- y)P{r > y/c}dy, (19) 

because 6 < c. By condition (@]), P{r > y/c} < K\F(y), for some K\ and all y. Therefore, the 
inequality 



rbx/c 

P 2 < KK\ I F{x - y)F(y)dy = o(F(x)) as x -> oo (20) 
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follows from b/c < 1 and from F £ ,y*. Indeed, for any -distribution, 

r x— h(x) 
lh{x) 



rx—h(x) 

/ F{x — y)F(y)dy = o(F(x)) asx^oo, (21) 

Jh(x) 



for any function h(x) — > oo such that h(x) < x/2 (see, e.g., |[T8l ). 

Now we estimate the third term on the right in (fTTT ) using condition (0]): 

P3 < P{cr > x} = o(F(x)) as x -> 00. (22) 

Altogether relations (PT8T ). (l20l ). and ((22)) complete the proof of Theorem [TJ 
Now we provide an example where 

P{5 r > x} 

— =— > 00 

F(x) 

given that condition ((U) is satisfied only with c = E£ > and not with any bigger c. Assume 
that F is a Weibull distribution on the positive half line with parameter j3 € (1/2, 1), that is 
F{x) = e~ x>3 . Let r have a distribution such that P{cr > x} ~ x~ 1 e~ a: ' 3 as x — ► 00. Write down 
the following lower bound: 

P{S T > x} > P{S r > x|cr > x - \/x}P{ct > 2 - \/x}. 

By the Central Limit Theorem, 

5 = liminf P{S T > x\ct > x — y/x} > liminf P{5r/ X ._ /^y c i > x} > 0. 

a:— »oo x— >oo LV V 7/ J 

Hence, 

liminf P{ ^ >X} > * liminf 

x-*oo F(x) x^co F(x) 

e xP-(x-^/x-f 

= 5 liminf — — = cxd, 

x^oo X — \ X 



because (3 > 1/2. 

We conclude this section by an example showing that the conclusion of Theorem[T]cannot hold 
for all subexponential distributions. Indeed, take F with negative mean as described in Theorem 
IU Without loss of generality we assume that the series Y^ k n k 1 m n k converge. Consider r taking 
values n k with probabilities cm 2 n k /n\, here c is the normalising constant. Then r has a finite 
mean, but 



rQ^ lll^ Tl h 

P{S T > x k } > P{S nk > x k }P{r = n k } > c-^F(x k )^±., 



so that, as A; — ► 00, 

P{S T > X k } 

F(x k ) 



OO. 
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5. The case where £ and r may be tail-comparable 

In this section we do not assume condition (0]) to hold, such a situation is of particular impor- 
tance for branching processes. To start with, we define two important classes of distributions. 

A distribution F is called dominated varying if there exists c such that F(x) < cF(2x) for all 
x. It is known that any long-tailed and dominated varying distribution with a finite mean belongs 
to the class see lfl8l 

We say that a distribution G is intermediate regularly varying (at infinity) if 

lim lim sup g)x) = 1 . (23) 

e|0 x^oo G(x) 

In particular, any regularly varying at infinity distribution satisfies the latter relation. Any interme- 
diate regularly varying distribution is long-tailed and dominated varying; in particular, it belongs 
to the class y*, provided its mean is finite. 

Theorem 7. Let F G SP*, E£ > 0, and 

F(x) = 0(P{t > x}) as x -> oo. (24) 

If the distribution of r is intermediate regularly varying, then 

P{5 T > x} ~ P{M r > x} ~ ErF(x) + P{t > x/E£} as x -» oo. (25) 

We strongly believe that the statement of the theorem stays valid in a more general setting 
where the distribution of r is assumed to be square-root insensitive, that is P{r > x ± y^x} ~ 
P{r > x}, and the variance of £ is finite. Probably, some further minor regularity assumptions 
are required. For example, the Weibull distribution F(x) = e~ x>3 with parameter (3 < 1/2 is 
square-root insensitive. For distribution which is not square-root insensitive, the asymptotics are 
different and more complicated. 

Proof of Theorem^ By d23l , for any fixed 5 > 0, we can choose a < E£ and c > E£ sufficiently 
close to E£ such that 

l-S/2< liminf P i ar > *} < lim P{cr > x} < 

7 - ^->oo P{ T > x/E£} - ^oo P P{r > x/E£} ~ 7 

Then, due to S T < M T , it is sufficient to prove the following lower bound for the sum 

P{St>:e} > (Er + o(l))F(x) + (1 + o(l))P{r > x/a}. (26) 
and the upper bound for the maximum 

P{M T >x} < (Er + o(l))F(x) + (1 + o(l))P{r > x/c} as x -> oo. (27) 
We have 

P{SV > x} = P{SV > x,r < x/a} + P{S T > x,r > x/a}. 

Since a < E£, P{SV > x|r > x/a} — ► 1 as x — > oo, by the Law of Large Numbers. Now the 
standard arguments lead to d26l ). 
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To prove the upper bound, we use a representation similar to (fTTT ) (see the previous proof): 

P{M r >x} = P{M T > x,t < N(x)} + P{M T > x,t E (N(x),x/c}} + P{M T > x,ct > x] 
= P 1 + P 2 + P 3 . 

The first summand Pi can be treated as ealier. The second summand P 2 can be estimated as 
follows: if condition (1241 holds then, by estimate (fT9l ), 

/•bx/c 

P2 < KK 2 / P{r > x - y}P{r > y}dy, 

for some K 2 . Since the distribution of r is intermediate regularly varying and, therefore, belongs 
to y*, 

P 2 = o(P{r > x}). 

Taking into account also that P3 < P{cr > x}, we finally get 

P{M T > x} < (Er + o(l))F(x) + P{t > x/c} + o(P{t > x}) as x -> 00. 

Since the distribution of r is (in particular) dominated varying, P{r > x} = 0(P{r > x/c}). 
Therefore, (|27T ) is proved and the conclusion of Theorem |7] follows. 

Theorem 8. Let E£ > and let r have an intermediate regularly varying distribution. If the 
distribution F is long-tailed and dominated varying, then (1251 ) holds. 

A particular corollary is that if both £ and r have regularly varying tail distributions, then 
asymptotics (|25T > hold; this result was proved by Stam ll37l Theorems 1.3 and 1.4] for positive 
£ and by A. Borovkov and K. Borovkov j3l Section 7.1] for signed £. Also, Theorems [7] and [8] 
generalise and improve Theorem 1.3 of Aleskevicene et al. HI. 

Proof of Theorem^ It follows the lines of the previous proof, and only the term P 2 needs a dif- 
ferent estimation. From bound (fl9l >. we get 

r-bx/c 

P 2 < KF(x-bx/c) P{cT>y}dy. 

J iV(a;)E£ 

Since F is dominated varying, F{x — bx/c) = 0{F{x)) as x — > 00. Therefore, P2 = 
and the proof is complete. 

6. Applications to the branching processes 

A Galton-Watson process is a stochastic process {X n } which evolves according to the recur- 
rence formula Xq = 1 and 

X n 

Xn+1 — ' 

where {^j } is a family of independent identically distributed non-negative integer- valued ran- 
dom variables with a finite mean, and their common distribution does not depend on n. Here X n 
is the number of items in the nth generation. Taking into account that any intermediate regularly 
varying distribution with finite mean belongs to the class y* , we obtain the following application 
of Theorem |7]to the branching process: 
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Corollary 2. Let the common distribution of £ 's be intermediate regularly varying. Then, as 

x — > oo, 

P{X 2 > x} ~ E£P{£ > x} + P{£ > x/E£}. 

In particular, if the branching process is critical, i.e. if E£; = 1, then 

P{X 2 > x} ~ 2P{£ > x} as x -» oo. 

More generally, by induction arguments, the tail of the distribution of the number of items in the 
nth generation is asymptotically equivalent to nP{( > x}. A similar result (for critical process) 
was obtained in [|3U Theorem 2] in the case of regularly varying distribution of £'s and for possibly 
growing n. 

7. Equivalences in the case where a counting random variable r may depend on £'s 

We continue to assume that random variables {£„} are independent and identically distributed. 
For any family H of random variables, denote by c(H) the cr-algebra generated by S. Tradition- 
ally, a counting random variable r is called a stopping time for a sequence if {r < n} G 
o-(£i,...,£ n )foralln. 

We say that a counting random variable r does «o? depend on the future of the sequence {£ n } 
if the family . . . , £ n , I{r < n}) does not depend on > n + 1) for all n. Dependence 
of this type goes back to Kolmogorov and Prokhorov |fT9l who proved Wald's identity under the 
condition that the event {r < n} does not depend on £j for all n > 1 and j > n + 1. 

Provided independence of £'s, any stopping time r does not depend on the future of the se- 
quence {£n}- If a counting random variable r does not depend on £'s, then it does not depend on 
the future of the sequence {£ n }- 

Let £P n be a filtration of er-algebras. A counting random variable r is called a stopping time for 
this filtration if {t < n} £ ^ n for all n. In this terminology, r is a stopping time for a sequence 
{£„} if and only if r is a stopping time for the natural filtration = <r(£i, . . . , £ n ). 

Consider a special filtration & n = a{^k,l{r = k}, k < n). Then r is a stopping time for 
this filtration. In addition, r does not depend on the future of the sequence if and only if 
(£i> j > n + 1) does not depend on for all n. 

We start with a result for a bounded counting stopping time (recall that a random variable is 
bounded if its distribution has a bounded support). 

Theorem 9. Let £ have a subexponential distribution F on R (we do not assume finite mean ), 
and let the counting variable r do not depend on the future. If t is bounded, then P{5V > x} ~ 
Eri ? (x) as x — > oo. 

Similar result for M T may be found in lTl4l Theorem 1]. Note that one cannot expect the latter 
asymptotics to hold for any r with unbounded support, which may depend on - even for a 
stopping time. Indeed, consider a stopping time r = min{n : S n < 0}. If E£ < then Er is 
finite but P{S T > x} = for any x > 0. 

Proof. We adopt the corresponding proof from Greenwood |[T6l where a stopping time and regu- 
larly varying tails were considered. Let be such that P{r < N} = 1. The starting point of the 
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proof is the following representation: 

JV 



P{5 T >x} = J^(P{S„ > x,t > n} -P{S n > x,t > n + 1}) 

n=l 

N 

= P{5i > x, t > 1} + ^2(P{S n > x,r>n}- PjSW-i > x, r > n}). 



n=2 

Therefore, 

iV 

P{5 r >a;} = F(x) + ^(P{,S n _i < x,S n > x,t > n} - P{S n _i > x,S n < x,t > n}). 

n=2 

Now it suffices to show that, for each n, 

Pi = P{5 n _i < x, S n > x, t > n} ~ F(x)P{t > n} (28) 

and 

P 2 = P{5 n _i > x, S n < x, t > n} = o(F(x)). (29) 
The subexponentiality of F implies that, for each n > 2, 

P{5„ > x} ~ riF(x) d&x^oo. (30) 
In particular, there exists c such that, for all n = 2, . . . , N, 

P{S" n >x} < cF(x) for all x. (31) 
The subexponentiality of F also implies, for any A(x) — ► oo such that F(x + A(x)) ~ F(x), 

rx+A(x) 

/ F(x-y)F(dy) = o(F(x)) as x -> oo. (32) 



To establish d28l , we first note that {t > n} = {r < n — 1} and thus <j(S' n _i, I{r > n}) 
does not depend on £ n , since r does not depend on the future. This implies 

/•oo 

P 1 = ~P{S n -i e (x - y,x],£ n e dy,r > n} 

Jo 

/•oo 

= / P{S n -i £ (x — y, x],t > n}F(dy). 
Jo 

We use the following decomposition, A > 0: 

(/■A px+A poo \ 
/ + / +/ P{^_i G (x-y,x],T>n}F(dy) 
Jo J A Jx+AJ 

ee / 1+ / 2 + / 3 . (33) 
By d30l and by the long-tailedness of F, for any fixed A, 

h < P{S n -i G (x - A, x}} = o(F(x)) as x -» oo. (34) 
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By <|3B and 02) we get, for A = A(x) -> oo, 

/ 2 < r +A p{5 n _i >x-y}F(dy) 

< c / F(x - y)F{dy) = o{F{x)) as x -> oo. (35) 

Uniformly in y > x + A(x), P{5 n _i G (a; — y, x], r > re} — > P{r > n} as x — > oo. Thus, 

J 3 ~ P{ T > n}F(x + A(x)) ~ P{r > n}F(x) as x -> oo. (36) 

Substituting (l34l)-d36l) into 03) we get (l28l . 
To prove (l29l) we note that 

P 2 < P{5 n _i G (x,x + A]} + P{S n _i > x + A}F(-A). 

As in 0D> the first term on the right is of order o(F(x)). Due to (|3TT ). the second term is not 
greater than cF{x)F{— A) where F(— A) can be made as small as we please by the choice of 
sufficiently large A. The proof is complete. 

Here is our general result for a counting random variable with, possibly, unbounded support. 

Theorem 10. Let E|£| < oo and let a counting variable t do not depend on the future. Assume 
that F G 5?* and that there exists an increasing function h(x) such that 

F(x ± h(x)) ~ F(x) and P{r > h(x)} = o{F{x)) as x ^ oo. (37) 

Then P{5 T > x} ~ EtF(x) as x — > oo. 

Proof of Theorem [lOlfollows from Lemmas [T] and [2] below. Condition (l37l) is stronger than con- 
dition 01). At the end of this section, we provide an example of a stopping time which shows that 
condition QTT ) is essential and cannot be weakened to 01)- 

Lemma 1. Let E£ > and let a counting variable r do not depend on the future. If F is long- 
tailed then 

.. . P{S T > x} 

lim mf — ^= > Er. 

x^co F{x) 

If, in addition, F G 5?* and condition d37| ) holds, then P{SV > x} ~ Eri ? (x) as x — > oo. 
Proof. Fix a positive integer N and a positive A. The following lower bound holds, for x > A: 

N 

P{S T >x} > J2P{Si,...,S j - 1 e[-A,A},^ j >x + 2A,S T >x,T>j} 
i=i 

N 

> V P{5i, . . . , Sj-i G [-A, A], > x + 2A, miuOSi - 5A > -A, r > j}. 



18 



Since {r > j} = {r < j — 1} and since r does not depend on the future, 

N 

P{S T > x} > V P{5i, . . . , £ A],r> j}P(0 > a; + 2A, min(S; - 5,) > -A} 



3=1 

N 

F(x + 2A)P{mmSi > -A} V P{5i, . . . , 5 3 -_i € [-4,A],r>i}. 

i>l z — ' 

i=i 



By the long-tailedness of F, 

N 



liminf P ^ T > ^ > Pfminfii > -A}VP{Si 5 M 6 [-4,4],t > j}. 

x^oo F( x ) i>l ^— ' 

Since the mean of £ is positive, P{minj>i 5, > —A} — > 1 as A — > oo. Hence, for any iV, 



|jmjiif P{6V>x} ^ * ^ 



Letting now N — > cxd completes the proof of the lower bound. 
The upper bound, 

P{S T >x\ 
lim sup — _ < Er, 

a;-+oo F(x) 

follows from (HI Corollary 3] which states that, under the conditions F £ ^* and (O, P{M r > 
x} ~ F(x)Er as x — > cxd. The proof is complete. 

Lemma 2. Let E£ < and let a counting variable r do not depend on the future. If F £ 5?* , 
then 

P{5 T > x] 
hm sup = < Er. 

x^oo F(x) 

Under the additional condition d37| ), P{SV > x} ~ ~EtF(x) as x — > cxd. 



Proof. The upper bound follows from 11151 Corollary 3] in the same way as the upper bound in 
the previous proof. To obtain the lower bound, take any positive e and consider a random walk 
S n = S n + n(|E£| + e) with a positive drift. We have 

P{S T >x} = P{S T > x + (|E£| +e)r} 

> P{S T > x + (|E£| + e)/i(x)} - P{r > 

Here the last term in the right side is o(F(x)) and, by Lemma [U the first term is equivalent to 
EtF(x + (|E£| + e)h(x)) ~ EtF(x) as x — > cxd. This completes the proof. 

For intermediate regularly varying tail distributions, Theorem [10] implies the following 

Corollary 3. Let E|£| < cxd Ze? a counting variable r c/o not depend on the future. Assume 
that F is an intermediate regularly varying distribution and that 

P{r > x} = o(F(x)) as x -> cxd. (38) 

Then P{S T > x} ~ Eri ? (x) as cc — > oo. 
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The latter corollary generalises the corresponding result by Greenwood and Monroe ifTTl The- 
orem 1] where a regularly varying F and a stopping time r were considered. In J51 Theorem 2], A. 
Borovkov and Utev obtained an upper bound for the tail distribution of S T assuming that both tail 
distributions of £1 and of r are bounded from above by the same dominated varying distribution. 

Proof. From condition (I38T ). for any e > 0, 

P{r > ex} = o(F(ex)) = o(F(x)) as x — ► oo, 

since F is intermediate regularly varying. Thus, there exists an increasing function h(x) = o(x) 
such that P{r > h(x)} = o(F(x)) as x —> oo. Again by the intermediate regular variation of F, 
for any h{x) = o(x), F(x ± h(x)) ~ F(x). So, condition (l37l) is fulfilled and we can conclude 
the desired asymptotics from Theorem [lOl 

We conclude with an example of a stopping time r showing that condition (I37T ) is essential for 
the conclusion of Theorem [TOj Consider a distribution F on [1, oo). Take an increasing function 
H(x) : R — > Z + such that H(x) < x/2. The counting random variable r = H(2^\) + 1 is a 
stopping time. On the event £i > x — -ff(x) we have r > H(2(x — H(x))) + 1 > H(x) + 1. 
Hence, 

P{S T >X}> P{a > X - i?(x), 6 + • • • + > ^ (x)} = P{6 > X - F(x)}, 

due to £ > 1. For a Weibull type distribution, namely F{x) = e _a: , < f3 < 1, x > 1, we can 
choose H(x) in such a way that H(x) = o(x) and H{x)/x 1 ^ 13 —> oo as x — > cxd. Then condition 
dU) holds, but asymptotics ([3]) does not, because F(x — H{x))/F(x) — > cc and 

P{S* r > x} 

— =— — > oo. 

F(x) 

In this example there is no a function /i(x) such that condition (I37T ) holds. Indeed, if F(x—h(x)) ~ 
F(x) then /i(x) = o(x 1- ^) and H~ 1 (h(x) — 1) = o(x) which implies 

P{r > h(x)}/F(x) = P{H(2£) > h(x) - 1}/F(x) -» oo as x ^ oo. 
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